The Making of a Newspaper Interview in Virtual Reality: Realistic Avatars, Philosophy, and Sushi.

VR United is a virtual reality application that we have developed to support multiple people simultaneously interacting in the same environment. Each person is represented with a virtual body that looks like themselves. Such immersive shared environments have existed and been the subject of research for the past 30 years. Here, we demonstrate how VR United meets criteria for successful interaction, where a journalist from the Financial Times in London interviewed a professor in New York for two hours. The virtual location of the interview was a restaurant, in line with the series of interviews published as "Lunch with the FT." We show how the interview was successful, as a substitute for a physically present one. The article based on the interview was published in the Financial Times as normal for the series. We finally consider the future development of such systems, including some implications for immersive journalism.

3D objects reconstruction from frontal images: an example with guitars.

This work deals with the automatic 3D reconstruction of objects from frontal RGB images. This aims at a better understanding of the reconstruction of 3D objects from RGB images and their use in immersive virtual environments. We propose a complete workflow that can be easily adapted to almost any other family of rigid objects. To explain and validate our method, we focus on guitars. First, we detect and segment the guitars present in the image using semantic segmentation methods based on convolutional neural networks. In a second step, we perform the final 3D reconstruction of the guitar by warping the rendered depth maps of a fitted 3D template in 2D image space to match the input silhouette. We validated our method by obtaining guitar reconstructions from real input images and renders of all guitar models available in the ShapeNet database. Numerical results for different object families were obtained by computing standard mesh evaluation metrics such as Intersection over Union, Chamfer Distance, and the F-score. The results of this study show that our method can automatically generate high-quality 3D object reconstructions from frontal images using various segmentation and 3D reconstruction techniques.

Automated virtual reality cognitive therapy versus virtual reality mental relaxation therapy for the treatment of persistent persecutory delusions in patients with psychosis (THRIVE): a parallel-group, single-blind, randomised controlled trial in England with mediation analyses.

BACKGROUND: Persecutory delusions are a major psychiatric problem that often do not respond sufficiently to standard pharmacological or psychological treatments. We developed a new brief automated virtual reality (VR) cognitive treatment that has the potential to be used easily in clinical services. We aimed to compare VR cognitive therapy with an alternative VR therapy (mental relaxation), with an emphasis on understanding potential mechanisms of action. METHODS: THRIVE was a parallel-group, single-blind, randomised controlled trial across four UK National Health Service trusts in England. Participants were included if they were aged 16 years or older, had a persistent (at least 3 months) persecutory delusion held with at least 50% conviction, reported feeling threatened when outside with other people, and had a primary diagnosis from the referring clinical team of a non-affective psychotic disorder. We randomly assigned (1:1) patients to either THRIVE VR cognitive therapy or VR mental relaxation, using a permuted blocks algorithm with randomly varying block size, stratified by severity of delusion. Usual care continued for all participants. Each VR therapy was provided in four sessions over approximately 4 weeks, supported by an assistant psychologist or clinical psychologist. Trial assessors were masked to group allocation. Outcomes were assessed at 0, 2 (therapy mid-point), 4 (primary endpoint, end of treatment), 8, 16, and 24 weeks. The primary outcome was persecutory delusion conviction, assessed by the Psychotic Symptoms Rating Scale (PSYRATS; rated 0-100%). Outcome analyses were done in the intention-to-treat population. We assessed the treatment credibility and expectancy of the interventions and the two mechanisms (defence behaviours and safety beliefs) that the cognitive intervention was designed to target. This trial is prospectively registered with the ISRCTN registry, ISRCTN12497310. FINDINGS: From Sept 21, 2018, to May 13, 2021 (with a pause due to COVID-19 pandemic restrictions from March 16, 2020, to Sept 14, 2020), we recruited 80 participants with persistent persecutory delusions (49 [61%] men, 31 [39%] women, with a mean age of 40 years [SD 13, range 18-73], 64 [80%] White, six [8%] Black, one [1%] Indian, three [4%] Pakistani, and six [8%] other race or ethnicity). We randomly assigned 39 (49%) participants assigned to VR cognitive therapy and 41 (51%) participants to VR mental relaxation. 33 (85%) participants who were assigned to VR cognitive therapy attended all four sessions, and 35 (85%) participants assigned to VR mental relaxation attended all four sessions. We found no significant differences between the two VR interventions in participant ratings of treatment credibility (adjusted mean difference -1·55 [95% CI -3·68 to 0·58]; p=0·15) and outcome expectancy (-0·91 [-3·42 to 1·61]; p=0·47). 77 (96%) participants provided follow-up data at the primary timepoint. Compared with VR mental relaxation, VR cognitive therapy did not lead to a greater improvement in persecutory delusions (adjusted mean difference -2·16 [-12·77 to 8·44]; p=0·69). Compared with VR mental relaxation, VR cognitive therapy did not lead to a greater reduction in use of defence behaviours (adjusted mean difference -0·71 [-4·21 to 2·79]; p=0·69) or a greater increase in belief in safety (-5·89 [-16·83 to 5·05]; p=0·29). There were 17 serious adverse events unrelated to the trial (ten events in seven participants in the VR cognitive therapy group and seven events in five participants in the VR mental relaxation group). INTERPRETATION: The two VR interventions performed similarly, despite the fact that they had been designed to affect different mechanisms. Both interventions had high uptake rates and were associated with large improvements in persecutory delusions but it cannot be determined that the treatments accounted for the change. Immersive technologies hold promise for the treatment of severe mental health problems. However, their use will likely benefit from experimental research on the application of different therapeutic techniques and the effects on a range of potential mechanisms of action. FUNDING: Medical Research Council Developmental Pathway Funding Scheme and National Institute for Health and Care Research Oxford Health Biomedical Research Centre.

The sentiment of a virtual rock concert.

We created a virtual reality version of a 1983 performance by Dire Straits, this being a highly complex scenario consisting of both the virtual band performance and the appearance and behaviour of the virtual audience surrounding the participants. Our goal was to understand the responses of participants, and to learn how this type of scenario might be improved for later reconstructions of other concerts. To understand the responses of participants we carried out two studies which used sentiment analysis of texts written by the participants. Study 1 (n = 25) (Beacco et al. in IEEE Virtual Reality: 538-545, 2021) had the unexpected finding that negative sentiment was caused by the virtual audience, where e.g. some participants were fearful of being harassed by audience members. In Study 2 (n = 26) notwithstanding some changes, the audience again led to negative sentiment-e.g. a feeling of being stared at. For Study 2 we compared sentiment with questionnaire scores, finding that the illusion of being at the concert was associated with positive sentiment for males but negative for females. Overall, we found sentiment was dominated by responses to the audience rather than the band. Participants had been placed in an unusual situation, being alone at a concert, surrounded by strangers, who seemed to pose a social threat for some  of them. We relate our findings to the concept of Plausibility, the illusion that events and situations in the VR are really happening. The results indicate high Plausibility, since the negative sentiment, for example in response to being started at, only makes sense if the events are experienced as actually happening. We conclude with the need for co-design of VR scenarios, and the use of sentiment analysis in this process, rather than sole reliance on concepts proposed by researchers, typically expressed through questionnaires, which may not reflect the experiences of participants. Supplementary Information: The online version contains supplementary material available at 10.1007/s10055-022-00685-9.

Self-observation of a virtual body-double engaged in social interaction reduces persecutory thoughts.

The proportion of the population who experience persecutory thoughts is 10-15%. People then engage in safety-seeking behaviours, typically avoiding social interactions, which prevents disconfirmatory experiences and hence paranoia persists. Here we show that persecutory thoughts can be reduced if prior to engaging in social interaction in VR participants first see their virtual body-double doing so. Thirty non-clinical participants were recruited to take part in a study, where they were embodied in a virtual body that closely resembled themselves, and asked to interact with members of a crowd. In the Random condition (n = 15) they observed their body-double wandering around but not engaging with the crowd. In the Targeted condition the body-double correctly interacted with members of the crowd. The Green Paranoid Thoughts Scale was measured 1 week before and 1 week after the exposure and decreased only for those in the Targeted condition. The results suggest that the observation of the body-double correctly carrying out a social interaction task in VR may lead to anxiety-reducing mental rehearsal for interaction thus overcoming safety behaviours. The results also extend knowledge of the effects of vicarious agency, suggesting that identification with the actions of body-double can influence subsequent psychological state.

Evaluating participant responses to a virtual reality experience using reinforcement learning.

Virtual reality applications depend on multiple factors, for example, quality of rendering, responsiveness, and interfaces. In order to evaluate the relative contributions of different factors to quality of experience, post-exposure questionnaires are typically used. Questionnaires are problematic as the questions can frame how participants think about their experience and cannot easily take account of non-additivity among the various factors. Traditional experimental design can incorporate non-additivity but with a large factorial design table beyond two factors. Here, we extend a previous method by introducing a reinforcement learning (RL) agent that proposes possible changes to factor levels during the exposure and requires the participant to either accept these or not. Eventually, the RL converges on a policy where no further proposed changes are accepted. An experiment was carried out with 20 participants where four binary factors were considered. A consistent configuration of factors emerged where participants preferred to use a teleportation technique for navigation (compared to walking-in-place), a full-body representation (rather than hands only), the responsiveness of virtual human characters (compared to being ignored) and realistic compared to cartoon rendering. We propose this new method to evaluate participant choices and discuss various extensions.

An Embodied Perspective as a Victim of Sexual Harassment in Virtual Reality Reduces Action Conformity in a Later Milgram Obedience Scenario.

Group pressure can often result in people carrying out harmful actions towards others that they would not normally carry out by themselves. However, few studies have manipulated factors that might overcome this. Here male participants (n = 60) were in a virtual reality (VR) scenario of sexual harassment (SH) of a lone woman by a group of males in a bar. Participants were either only embodied as one of the males (Group, n = 20), or also as the woman (Woman, n = 20). A control group (n = 20) only experienced the empty bar, not the SH. One week later they were the Teacher in a VR version of Milgram's Obedience experiment where they were encouraged to give shocks to a female Learner by a group of 3 virtual males. Those who had been in the Woman condition gave about half the number of shocks of those in the Group condition, with the controls between these two. We explain the results through embodiment promoting identification with the woman or the group, and delegitimization of the group for those in the Woman condition. The experiment raised important ethical issues, showing that a VR study with positive ethical intentions can sometimes produce unexpected and non-beneficent results.

Virtual body ownership and its consequences for implicit racial bias are dependent on social context.

When people hold implicit biases against a group they typically engage in discriminatory behaviour against group members. In the context of the implicit racial bias of 'White' against 'Black' people, it has been shown several times that implicit bias is reduced after a short exposure of embodiment in a dark-skinned body in virtual reality. Embodiment usually leads to the illusion of ownership over the virtual body, irrespective of its skin colour. Previous studies have been carried out in virtual scenarios that are affectively neutral or positive. Here, we show that when the scenario is affectively negative the illusion of body ownership of White participants over a White body is lessened, and implicit bias is higher for White participants in a Black virtual body. The study was carried out with 92 White female participants, in a between-groups design with two factors: BodyType (their virtual body was White or Black) and a surrounding Crowd was Negative, Neutral or Positive towards the participant. We argue that negative affect prevents the formation of new positive associations with Black and distress leads to disownership of the virtual body. Although virtual reality is often thought of as an 'empathy machine' our results suggest caution, that this may not be universally the case.

Virtually Being Lenin Enhances Presence and Engagement in a Scene From the Russian Revolution.

Virtual Reality (VR) has been widely applied to cultural heritage such as the reconstruction of ancient sites and artifacts. It has hardly been applied to the reprise of specific important moments in history. On the other hand immersive journalism does attempt to recreate current events in VR, but such applications typically give the viewer a disembodied non-participatory role in the scene of interest. Here we show how VR was used to reconstruct a specific historical event, where a famous photograph was brought to life, showing Lenin, the leader of the 1917 October Russian Revolution, giving a speech to Red Army recruits in Moscow 1920. We carried out a between groups experimental study with three conditions: Embodied-where the participant was first embodied as Lenin and then later in the audience watching Lenin; Included-where the participant was not embodied as Lenin but was embodied as part of the audience; and Observing-where the participant mainly viewed the scene from a disembodied third person point of view. Twenty participants were assigned to each of the three conditions in a between-groups design. We found that the level of presence was greatest in the Embodied and Included conditions, and that participants were least likely to later follow up information about the Russian Revolution in the Observing condition. Our conclusion is that if the VR setup allows for a period of embodiment as a character in the scenario then this should be employed in order to maximize the chance of participant presence and engagement with the story.

The Responses of Medical General Practitioners to Unreasonable Patient Demand for Antibiotics--A Study of Medical Ethics Using Immersive Virtual Reality.

BACKGROUND: Dealing with insistent patient demand for antibiotics is an all too common part of a General Practitioner's daily routine. This study explores the extent to which portable Immersive Virtual Reality technology can help us gain an accurate understanding of the factors that influence a doctor's response to the ethical challenge underlying such tenacious requests for antibiotics (given the threat posed by growing anti-bacterial resistance worldwide). It also considers the potential of such technology to train doctors to face such dilemmas. EXPERIMENT: Twelve experienced GPs and nine trainees were confronted with an increasingly angry demand by a woman to prescribe antibiotics to her mother in the face of inconclusive evidence that such antibiotic prescription is necessary. The daughter and mother were virtual characters displayed in immersive virtual reality. The specific purposes of the study were twofold: first, whether experienced GPs would be more resistant to patient demands than the trainees, and second, to investigate whether medical doctors would take the virtual situation seriously. RESULTS: Eight out of the 9 trainees prescribed the antibiotics, whereas 7 out of the 12 GPs did so. On the basis of a Bayesian analysis, these results yield reasonable statistical evidence in favor of the notion that experienced GPs are more likely to withstand the pressure to prescribe antibiotics than trainee doctors, thus answering our first question positively. As for the second question, a post experience questionnaire assessing the participants' level of presence (together with participants' feedback and body language) suggested that overall participants did tend towards the illusion of being in the consultation room depicted in the virtual reality and that the virtual consultation taking place was really happening.